Exploring the Impact of a Sleep App on Sleep Quality in a General Population Sample: Pilot Randomized Controlled Trial

Background A third of adults in Western countries have impaired sleep quality. A possible solution involves distributing sleep aids through smartphone apps, but most empirical studies are limited to small pilot trials in distinct populations (eg, soldiers) or individuals with clinical sleep disorders; therefore, general population data are required. Furthermore, recent research shows that sleep app users desire a personalized approach, offering an individually tailored choice of techniques. One such aid is Peak Sleep, a smartphone app based on scientifically validated principles for improving sleep quality, such as mindfulness meditation and cognitive behavioral therapy. Objective We aimed to test the impact of the smartphone app Peak Sleep on sleep quality and collect user experience data to allow for future app development. Methods This was a 2-arm pilot randomized controlled trial. Participants were general population adults in the United Kingdom (aged ≥18 years) who were interested in improving their sleep quality and were not undergoing clinical treatment for sleep disorder or using sleep medication ≥1 per week. Participants were individually randomized to receive the intervention (3 months of app use) versus a no-treatment control. The intervention involved free access to Peak Sleep, an app that offered a choice of behavioral techniques to support better sleep (mindfulness, cognitive behavioral therapy, and acceptance commitment therapy). The primary outcome was sleep quality assessed using the Insomnia Severity Index at baseline and 1-, 2-, and 3-month follow-ups. Assessments were remote using web-based questionnaires. Objective sleep data collection using the Oura Ring (Ōura Health Oy) was planned; however, because the COVID-19 pandemic lockdowns began just after recruitment started, this plan could not be realized. Participant engagement with the app was assessed using the Digital Behavior Change Intervention Engagement Scale and qualitative telephone interviews with a subsample. Results A total of 101 participants were enrolled in the trial, and 21 (21%) were qualitatively interviewed. Sleep quality improved in both groups over time, with Insomnia Severity Index scores of the intervention group improving by a mean of 2.5 and the control group by a mean of 1.6 (between-group mean difference 0.9, 95% CI –2.0 to 3.8), with was no significant effect of group (P=.91). App users’ engagement was mixed, with qualitative interviews supporting the view of a polarized sample who either strongly liked or disliked the app. Conclusions In this trial, self-reported sleep improved over time in both intervention and control arms, with no impact by group, suggesting no effect of the sleep app. Qualitative data suggested polarized views on liking or not liking the app, features that people engaged with, and areas for improvement. Future work could involve developing the app features and then testing the app using objective measures of sleep in a larger sample. Trial Registration ClinicalTrials.gov NCT04487483; https://www.clinicaltrials.gov/study/NCT04487483

Is this a full powered effectiveness trial or a pilot/feasibility trial?*

Manuscript tracking number *
If this is a JMIR submission, please provide the manuscript tracking number under "other" (The ms tracking number can be found in the submission acknowledgement email, or when you login as author in JMIR.If the paper is already published in JMIR, then the ms tracking number is the four-digit number at the end of the DOI, to be found at the bottom of each published article in JMIR) 1a) Does your paper address CONSORT item 1a? * I.e does the title contain the phrase "Randomized Controlled Trial"?(if not, explain the reason under "other") 13/05/2022, 23:32 CONSORT-EHEALTH (V 1.6.1)-Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q1l… 6/36 Identify the mode of delivery.Preferably use "web-based" and/or "mobile" and/or "electronic game" in the title.Avoid ambiguous terms like "online", "virtual", "interactive".Use "Internet-based" only if Intervention includes non-web-based Internet components (e.g.email), use "computer-based" or "electronic" only if offline products are used.Use "virtual" only in the context of "virtual reality" (3-D worlds).Use "online" only in the context of "online support groups".Complement or substitute product names with broader terms for the class of products (such as "mobile" or "smart phone" instead of "iphone"), especially if the application runs on different platforms.
Does your paper address subitem 1a-i?* Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Exploring the impact of a sleep app on sleep quality"

1a-ii) Non-web-based components or important co-interventions in title
Mention non-web-based components or important co-interventions in title, if any (e.g., "with telephone support").

Does your paper address subitem 1a-ii?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 1a-iii) Primary condition or target group in the title subitem not at all important 1 2 3 4 5 essential subitem not at all important 1 2 3 4 5 essential Does your paper address subitem 1a-iii?* Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "in a general population sample" 1b-i) Key features/functionalities/components of the intervention and comparator in the METHODS section of the ABSTRACT Mention key features/functionalities/components of the intervention and comparator in the abstract.If possible, also mention theories and principles used for designing the site.Keep in mind the needs of systematic reviewers and indexers by including important synonyms.(Note: Only report in the abstract what the main paper is reporting.If this information is missing from the main body of text, consider adding it) Does your paper address subitem 1b-i?* Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "One such aid is 'Peak Sleep'; a smartphone application based on scientifically validated principles for improving sleep quality, such as mindfulness meditation and cognitive behavioural therapy" "Participants were individually randomised to receive the intervention (3 months of app use) versus control" 1b-ii) Level of human involvement in the METHODS section of the ABSTRACT Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 1b-iii) Open vs. closed, web-based (self-assessment) vs. face-to-face assessments in the METHODS section of the ABSTRACT Does your paper address subitem 1b-iii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 1b-iv) RESULTS section in abstract must contain use data Does your paper address subitem 1b-iv?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Does your paper address subitem 1b-v?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 2a-i) Problem and the type of system/solution Describe the problem and the type of system/solution that is object of the study: intended as stand-alone intervention vs. incorporated in broader health care program?Intended for a particular patient population?Goals of the intervention, e.g., being more cost-effective to other interventions, replace or complement other solutions?(Note: Details about the intervention are provided in "Methods" under 5) Does your paper address subitem 2a-i?* Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Does your paper address subitem 4a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 4a-ii) Open vs. closed, web-based vs. face-to-face assessments: Open vs. closed, web-based vs. face-to-face assessments: Mention how participants were recruited (online vs. offline), e.g., from an open access website or from a clinic, and clarify if this was a purely webbased trial, or there were face-to-face components (as part of the intervention or for assessment), i.e., to what degree got the study team to know the participant.In online-only trials, clarify if participants were quasi-anonymous and whether having multiple identities was possible or whether technical or logistical measures (e.g., cookies, email confirmation, phone calls) were used to detect/prevent these.

Does your paper address subitem 4a-ii? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Participants were recruited via email cascade, social media and posters on the University College London campus" "Participants who registered interest were emailed an information sheet, eligibility screening and consent forms on REDCap software" "Participants completed the DBCI Engagement Scale weekly online" "Intervention participants were given free use of Peak Sleep (Peak Sleep Pro membership) for 3 months.They were instructed to use it daily by completing the "ritual" section of the app".
The study was online-only.Having multiple identities was not possible as there was direct correspondence via email, text message and sometimes phone call.

4a-iii) Information giving during recruitment
Information given during recruitment.Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Data was collected online from UK based participants 4b-i) Report if outcomes were (self-)assessed through online questionnaires Clearly report if outcomes were (self-)assessed through online questionnaires (as common in web-based trials) or otherwise.

Does your paper address subitem 4b-i? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "self-reported subjective sleep quality, using the Insomnia Severity Index" "self-reported subjective sleep, measured using the core Consensus Sleep Diary" "Participants completed the DBCI Engagement Scale weekly online" 4b-ii) Report how institutional affiliations are displayed Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-i) Mention names, credential, affiliations of the developers, sponsors, and owners
Mention names, credential, affiliations of the developers, sponsors, and owners [6] (if authors/evaluators are owners or developer of the software, this needs to be declared in a "Conflict of interest" section or mentioned elsewhere in the manuscript).

Does your paper address subitem 5-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-ii) Describe the history/development process
Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.

Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-iii) Revisions and updating
Revisions and updating.Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial.
Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b).
Does your paper address subitem 5-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-iv) Quality assurance methods
Provide information on quality assurance methods to ensure accuracy and quality of information provided [1], if applicable.

Does your paper address subitem 5-iv?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org,and/or publishing the source code or screenshots/videos alongside the article).As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login.

Does your paper address subitem 5-vi?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-vii) Access
Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of specific group.If known, describe how participants obtained "access to the platform and Internet" [1].To ensure access for editors/reviewers/readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi).

Does your paper address subitem 5-vii? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Intervention participants accessed the application through their smartphone."Intervention participants were given free use of Peak Sleep (Peak Sleep Pro membership) for 3 months".

Does your paper address subitem 5-viii? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "They were instructed to use it daily by completing the "ritual" section of the app (Figure 1).This is a daily ritual of: a sleep diary rating the previous night's sleep (to be completed in the morning); a 10-minute audio guide (in the hours winding down to bedtime); and rating of the guide.Peak Sleep amalgamates this information and uses it to recommend future guides.
There are multiple guides each involving a specific technique: relaxation music; CBT; acceptance and commitment therapy; progressive muscle relaxation; guided imagery; and mindfulness meditation.The app also allows users to override the recommended guide and choose their own.A "stats" section allows users to see the effect the techniques are having on their sleep (Figure 2)" "Brainbow LTD, the makers of the app Peak Sleep" "Aside from being asked to abstain from using sleep apps/trackers during the trial period and to complete study assessments, controls were assumed to continue lives as usual"

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use).Clarify what instructions or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum.

Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered".It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21 -generalizability).
Does your paper address subitem 5-x?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

5-xi) Report any prompts/reminders used
Report any prompts/reminders used: Clarify if there were prompts (letters, emails, phone calls, SMS) to use the application, what triggered them, frequency etc.It may be necessary to distinguish between the level of prompts/reminders required for the trial, and the level of prompts/reminders for a routine application outside of a RCT setting (discuss under item 21 -generalizability).

Does your paper address subitem 5-xi? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "They were instructed to use it daily by completing the "ritual" section of the app (Figure 1).This is a daily ritual of: a sleep diary rating the previous night's sleep (to be completed in the morning); a 10-minute audio guide (in the hours winding down to bedtime); and rating of the guide.Peak Sleep amalgamates this information and uses it to recommend future guides."This use of the app is what was regularly available to consumers outside of the study, the app itself sends notifications as reminders to use it, no reminders were provided by the researchers.

Does your paper address subitem 6a-i?
Copy and paste relevant sections from manuscript text Your answer 6a-ii) Describe whether and how "use" (including intensity of use/dosage) was defined/measured/monitored Describe whether and how "use" (including intensity of use/dosage) was defined/measured/monitored (logins, logfile analysis, etc.).Use/adoption metrics are important process outcomes that should be reported in any ehealth trial.Copy and paste relevant sections from manuscript text Your answer 6a-iii) Describe whether, how, and when qualitative feedback from participants was obtained Describe whether, how, and when qualitative feedback from participants was obtained (e.g., through emails, feedback forms, interviews, focus groups).

Does your paper address subitem 6a-iii?
Copy and paste relevant sections from manuscript text Your answer

Does your paper address CONSORT subitem 6b? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The original study plan also involved collecting objective sleep data using the Oura ring -a commercially available sleep tracker worn on a finger.However, objective assessments were cancelled due to COVID-19 restrictions" 7a-i) Describe whether and how expected attrition was taken into account when calculating the sample size Describe whether and how expected attrition was taken into account when calculating the sample size.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "randomised 1:1 to intervention or control (details below) using MinimPy software.Limited resources for the pilot meant it was not possible to blind researchers to group allocation." Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Limited resources for the pilot meant it was not possible to blind researchers to group allocation."All three steps were done by BA.
11a-i) Specify who was blinded, and who wasn't Specify who was blinded, and who wasn't.Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering co-interventions (if any).

Does your paper address subitem 11a-i? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Limited resources for the pilot meant it was not possible to blind researchers" 12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed 11a-ii) Discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".

Does your paper address subitem 11a-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

Does your paper address CONSORT subitem 11b? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Not relevant to this study Does your paper address CONSORT subitem 12a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "To analyse impact of the intervention versus control on sleep outcomes (ISI, Consensus sleep diary outcomes), Generalized Linear Mixed Models (GLMM) were run using the MIXED command with full information maximum likelihood estimation (to allow for participants with missing data to be analysed)" Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials.Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).
Does your paper address subitem 12a-i?* Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "using the MIXED command with full information maximum likelihood estimation (to allow for participants with missing data to be analysed"

Does your paper address CONSORT subitem 12b? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "As a planned secondary analysis, the level of engagement with the app in the intervention group was included as a covariate to assess whether it had any impact on findings" X26-i) Comment on ethics committee approval Does your paper address subitem X26-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

RESULTS
13a) For each group, the numbers of participants who were randomly assigned, received intended treatment, and were analysed for the primary outcome The number of care providers or centers performing the intervention in each group and the number of patients treated by each care provider in each center x26-ii) Outline informed consent procedures Outline informed consent procedures e.g., if consent was obtained offline or online (how?Checkbox, etc.?), and what information was provided (see 4a-ii).See [6] for some items to be included in informed consent documents.

Does your paper address subitem X26-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

X26-iii) Safety and security procedures
Safety and security procedures, incl.privacy considerations, and any steps taken to reduce the likelihood or detection of harm (e.g., education and training, availability of a hotline)

Does your paper address subitem X26-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer 13/05/2022, 23:33 CONSORT-EHEALTH (V 1.6.1)-Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 26/36 13b) For each group, losses and exclusions after randomisation, together with reasons subitem not at all important 1 2 3 4 5 essential 14a) Dates defining periods of recruitment and follow-up Does your paper address CONSORT subitem 13a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "144 expressed interest and 105 (73%) consented.3 withdrew after consent meaning 102 (71%) were enrolled and randomised. 1 participant withdrew after randomisation resulting in inclusion of 101 participants.96 (95%) completed all follow-up assessments.Of those allocated to intervention (n=50), 2 (4%) reported that they stopped using the app before the end of the trial period."and "Figure 3" Does your paper address CONSORT subitem 13b? (NOTE: Preferably, this is shown in a CONSORT flow diagram) * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study CONSORT flow diagram in Figure 3.

13b-i) Attrition diagram
Strongly recommended: An attrition diagram (e.g., proportion of participants still logging in or using the intervention/comparator in each group plotted over time, similar to a survival curve) or other figures or tables demonstrating usage/dose/engagement.

Does your paper address subitem 13b-i?
Copy and paste relevant sections from the manuscript or cite the figure number if applicable (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Timing of study assessments are summarised in Supplementary Figure 1.Quantitative measurement timepoints were T0 (baseline, prior to randomisation), T1 (1 month), T2 (2 months) and T3 (3 months).Qualitative interviews were conducted after study completion.Enrolment began on 13th of February 2020 and was completed by 17th of March 2020, so follow-up data collection periods coincided with the UK COVID-19 pandemic (the UK went into full lockdown from 23rd of March 2020 which was progressively eased from 11th of May 2020 onwards).Follow-up data was completed by the 17th of June 2020" 14a-i) Indicate if critical "secular events" fell into the study period Indicate if critical "secular events" fell into the study period, e.g., significant changes in Internet resources available or "changes in computer hardware or Internet delivery resources" Does your paper address subitem 14a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 14b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Not applicable to this study.

Does your paper address CONSORT subitem 15? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Baseline demographic and clinical characteristics are shown in Table 1 13/05/2022, 23:33 your paper address subitem 15-i?* and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Demographics associated with digital divide issues are reported in Table 1 16-i) Report multiple "denominators" and provide definitions Report multiple "denominators" and provide definitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at specific pre-defined time points of interest (in absolute and relative numbers per group).Always clearly define "use" of the intervention.

Does your paper address subitem 16-i? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "144 expressed interest and 105 (73%) consented.3 withdrew after consent meaning 102 (71%) were enrolled and randomised. 1 participant withdrew after randomisation resulting in inclusion of 101 participants.96 (95%) completed all follow-up assessments.Of those allocated to intervention (n=50), 2 (4%) reported that they stopped using the app before the end of the trial period."

16-ii) Primary analysis should be intent-to-treat
Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).
Copy and paste relevant sections from the manuscript quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "Change in ISI scores over time by group are presented in Figure 5.The effect of group (p=.011) and time (p=.044) were significant in the model (the intervention group had slightly higher ISI scores at each time point and both groups improved over time).However, there was no significant group × time interaction (p=.914), suggesting no effect of the intervention.We did not proceed with calculating an effect size because there was no group × time interaction.The intervention group improved over time by a mean of 2.5 whilst the control group improved by a mean of 1.6 (between-group mean difference, 0.9; 95% CI, -2.0, 3.8).Due to the small sample size, the randomisation failed to yield balance on the ISI.Therefore, a sensitivity analysis was also performed where baseline ISI was covaried, however, there was no difference in results." 17a-i) Presentation of process outcomes such as metrics of use and intensity of use In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational definitions is critical.This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length".These must be accompanied by a technical description how a metric like a "session" is defined (e.g., timeout after idle time) [1] (report under item 6a).

Does your paper address subitem 17a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Not applicable to this study as there were no binary outcomes Does your paper address CONSORT subitem 18? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "As a planned secondary analysis, the level of engagement with the app in the intervention group was included as a covariate to assess whether it had any impact on findings" "Including app engagement as a covariate did not change any of the findings, so these results are not reported.""Due to the small sample size, the randomisation failed to yield balance on the ISI.Therefore, a sensitivity analysis was also performed where baseline ISI was covaried, however, there was no difference in results."

18-i) Subgroup analysis of comparing only users
A subgroup analysis of comparing only users is not uncommon in ehealth trials, but if done, it must be stressed that this is a self-selected sample and no longer an unbiased sample from a randomized trial (see 16-iii).
Does your paper address subitem 18-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use).
Does your paper address subitem 22-i?* Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "This pilot RCT explored acceptability and early efficacy of the Peak Sleep app.Uptake and adherence to the study procedures and intervention were high.Experience of the intervention was mixed, with around half reporting higher engagement and half lower.Our primary outcome (change in sleep quality) suggested no significant effect of the intervention and none of the secondary sleep measures demonstrated any impact of the intervention.After the first month follow-up, both groups showed very similar improvements in sleep scores.This pilot RCT demonstrated that it would be possible to do a full scale RCT using the same study procedures"

22-ii) Highlight unanswered new questions, suggest future research
Highlight unanswered new questions, suggest future research.

Does your paper address subitem 22-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Your answer

20-i) Typical limitations in ehealth trials
Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded.Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error.Discuss biases due to non-use of the intervention/usability issues, biases through informed consent procedures, unexpected events.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "there were limitations to our study.Firstly, COVID-19 unexpectedly spanned the entire RCT and, as discussed, seems to have had an effect on some participant's sleep."and "The lack of the Oura ring follow-up was also an unforeseen limitation." and "One final limitation was the wording of the Consensus Sleep Diary questions"

21-i) Generalizability to other populations
Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations Does your paper address subitem 21-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study X27-i) State the relation of the study team towards the system being evaluated In addition to the usual declaration of interests (financial or otherwise), also state the relation of the study team the system being evaluated, i.e., state if the authors/evaluators are distinct from or identical with the developers/sponsors of the intervention.
Does your paper address subitem X27-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study

Your answer
As a result of using this checklist, did you make changes in your manuscript?* What were the most important changes you made as a result of using this checklist?-Save this form as PDF before you click submit To generate a record that you filled in this form, we recommend to generate a PDF of this page (on a Mac, simply select "print" and then select "print as PDF") before you submit it.
When you submit your (revised) paper to JMIR, please upload the PDF as supplementary file.
Don't worry if some text in the textboxes is cut off, as we still have the complete information in our database.
Identify the mode of delivery in the title Mention primary condition or target group in the title, if any (e.g., "for children with Type I Diabetes") Example: A Web-based and Mobile Intervention with Telephone Support for Children with Type I Diabetes: https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q1l… 7/36 Clarify the level of human involvement in the abstract, e.g., use phrases like "fully automated" vs. "therapist/nurse/care provider/physician-assisted" (mention number and expertise of providers involved, if any).(Note: Only report in the abstract what the main paper is reporting.If this information is missing from the main body of text, consider adding it) https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q1l… 8/36 Mention how participants were recruited (online vs. offline), e.g., from an open access website or from a clinic or a closed online user group (closed usergroup trial), and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment).Clearly say if outcomes were self-assessed through questionnaires (as common in web-based trials).Note: In traditional offline trials, an open trial (open-label trial) is a type of clinical trial in which both the researchers and participants know which treatment is being administered.To avoid confusion, use "blinded" or "unblinded" to indicated the level of blinding instead of "open", as "open" in web-based trials usually refers to "open access" (i.e.participants can self-enrol).(Note: Only report in the abstract what the main paper is reporting.If this information is missing from the main body of text, consider adding it) Conclusions/Discussions in abstract for negative trials: Discuss the primary outcome -if the trial is negative (primary outcome not changed), and the intervention was not used, discuss whether negative results are attributable to lack of uptake and discuss reasons.(Note: Only report in the abstract what the main paper is reporting.If this information is missing from the main body of text, consider adding it) https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q1l… 9/36 Scientific background, rationale: What is known about the (type of) system Scientific background, rationale: What is known about the (type of) system that is the object of the study (be sure to discuss the use of similar systems for other conditions/diagnoses, if appropiate), motivation for the study, i.e. what are the reasons for and what is the context for this specific study, from which stakeholder viewpoint is the study performed, potential impact of findings[2].Briefly justify the choice of the comparator.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study be resource intensive.A possible solution is smartphone-based interventions.Over 79% of UK adults use smartphones, offering an extremely wide potential population reach" "The majority of commercially available sleep apps focus on singular modes of intervention" "Peak Sleep aimed to address this gap by providing a choice of 6 evidence-based techniques" "the efficacy of Peak Sleep had not yet been tested" "the aim of the current study was to test the app's efficacy and gather user experience data, allowing for optimisation of the Peak Sleep app" 13/05/2022, 23:33 CONSORT-EHEALTH (V 1.6.1)-Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 10/36 Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing flowcharts of the algorithms used.Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scientific reporting.
https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 16/36 Mode of delivery, features/functionalities/components of the intervention and comparator, and the theoretical framework Describe mode of delivery, features/functionalities/components of the intervention and comparator, and the theoretical framework [6] used to design them (instructional strategy [1], behaviour change techniques, persuasive features, etc., see e.g.,[7, 8]for terminology).This includes an in-depth description of the content (including where it is coming from and who developed it) [1]," whether [and how] it is tailored to individual circumstances and allows users to track their progress and receive feedback"[6].This also includes a description of communication delivery channels and -if computermediated communication is a component -whether communication was synchronous or asynchronous[6].It also includes information on presentation strategies [1], including page design principles, average amount of text on pages, presence of hyperlinks to other resources, etc. [1].
https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 17/36 Describe any co-interventions (incl.training/support):Clearlystateanyinterventionsthatareprovided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as stand-alone intervention.This includes training sessions and support[1].It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21 -generalizability.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study There were no co-interventions.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "The primary sleep outcome was self-reported subjective sleep quality, using the Insomnia Severity Index (ISI)[23]assessed at T0, T1, T2 and T3" "A secondary outcome was self-reported subjective sleep, measured using the core Consensus Sleep Diary at T0 and T2" "Engagement with the app (intervention group only) was assessed using the Digital Behaviour Change Intervention (DBCI) Engagement Scale[22].Participants completed the DBCI Engagement Scale weekly online over the 3 months of the intervention" https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 19/36 6a-i) Online questionnaires: describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed If outcomes were obtained through online questionnaires, describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed[9].
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 21/36Not applicable to this study Does your paper address CONSORT subitem 8a? *Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "participants were randomised 1:1 to intervention or control (details below) using MinimPy software" https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 22/36 10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions 11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how NPT: Whether or not administering co-interventions were blinded to group assignment In ehealth trials it is particularly important to report demographics associated with digital divide issues, such as age, education, gender, social-economic status, computer/Internet/ehealth literacy of the participants, if known.
6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 28/36 Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "No adverse effects were reported."Copyandpaste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Include qualitative feedback from participants or observations from staff/researchers, if available, on strengths and shortcomings of the application, especially if they point to unintended/unexpected effects or uses.This includes (if available) reasons for why people did or did not use the application as intended by the developers.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use) https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 31/36 NPT: In addition, take into account the choice of comparator, lack of or partial blinding, and unequal expertise of care providers or centers in each group Does your paper address CONSORT subitem 19? * https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 32/36 Your answer 21-ii) Discuss if there were elements in the RCT that would be different in a routine application setting Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other co-interventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "ClinicalTrials.govNCT04487483"Doesyour paper address CONSORT subitem 24? * Cite a Multimedia Appendix, other reference, or copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "ClinicalTrials.govNCT04487483"Doesyourpaper address CONSORT subitem 25? *Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briefly explain why the item is not applicable/relevant for your study "This work was funded by Brainbow LTD, the makers of the app Peak Sleep.We thank Brainbow LTD for supplying participants with free memberships to their sleep app Peak Sleep for the purposes of this study and for allowing us to provide free one-year memberships of their main app Peak Brain Training to participants as a reward for completing the study." https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 34/36 How much time did you spend on going through the checklist INCLUDING making changes in your manuscript * Time spent was a total of four hours As a result of using this checklist, do you think your manuscript has improved?* https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_OimqcS64RdfIAFvmrTSkZQL2-3O8O9hrL5Sw/viewform?hl=en_US&formkey=dGlKd2Z2Q… 36/36 Thank you!Final step: Click submit !Click submit so we have your answers in our database!Never submit passwords through Google Forms.This content is neither created nor endorsed by Google.Report Abuse -Terms of Service -Privacy Policy Would you like to become involved in the CONSORT EHEALTH group?This would involve for example becoming involved in participating in a workshop and writing an "Explanation and Elaboration" document